Optimal control policies for evolutionary dynamics with environmental feedback
نویسندگان
چکیده
We study a dynamical model of a population of cooperators and defectors whose actions have long-term consequences on environmental “commons” what we term the “resource”. Cooperators contribute to restoring the resource whereas defectors degrade it. The population dynamics evolve according to a replicator equation coupled with an environmental state. Our goal is to identify methods of influencing the population with the objective to maximize accumulation of the resource. In particular, we consider strategies that modify individual-level incentives. We then extend the model to incorporate a public opinion state that imperfectly tracks the true environmental state, and study strategies that influence opinion. We formulate optimal control problems and solve them using numerical techniques to characterize locally optimal control policies for three problem formulations: 1) control of incentives, and control of opinions through 2) propaganda-like strategies and 3) awareness campaigns. We show numerically that the resulting controllers in all formulations achieve the objective, albeit with an unintended consequence. The resulting dynamics include cycles between low and high resource states a dynamical regime termed an “oscillating tragedy of the commons”. This outcome may have desirable average properties, but includes risks to resource depletion. Our findings suggest the need for new approaches to controlling coupled populationenvironment dynamics.
منابع مشابه
Control of a Chemical Reactor with Chaotic Dynamics
In this paper, control of a non-isothermal continuous stirred tank reactor in which two parallel autocatalytic reactions take place has been addressed. The reactor shows chaotic behavior for a certain set of reactor parameters. In order to control the product concentration, an optimal state feedback controller has been designed. Since concentrations of reactor species are ...
متن کاملAbstract: Evolutionary Agent-Based Policy Analysis in Dynamic Environments
This doctoral thesis combines methods from several scientific disciplines in order to design and evaluate public economic policies by means of evolutionary agent-based computation. It builds a simple and robust model of economic evolution where behavior evolves by imitation in a social network. It uses numeric agent-based simulations to investigate the evolutionary process under different envir...
متن کاملA Boltzmann approach to mean - field sparse feedback control ?
We study the synthesis of optimal control policies for large-scale multi-agent systems. The optimal control design induces a parsimonious control intervention by means of `1, sparsitypromoting control penalizations. We study instantaneous and infinite horizon sparse optimal feedback controllers. In order to circumvent the dimensionality issues associated to the control of large-scale agent-base...
متن کاملOptimal Control via Integrating the Dynamics of Magnetorheological Dampers and Structures
Magnetorheological (MR) dampers have the advantage of being tuned by low voltages. This has attracted many researchers to develop semi-active control of structures in theory and practice. Most of the control strategies first obtain the desired forces of dampers without taking their dynamics into consideration and then determine the input voltages according to those forces. As a result, these st...
متن کاملA new approach on studying the stability of evolutionary game dynamics for financial systems
Financial market modeling and prediction is a difficult problem and drastic changes of the price causes nonlinear dynamic that makes the price prediction one of the most challenging tasks for economists. Since markets always have been interesting for traders, many traders with various beliefs are highly active in a market. The competition among two agents of traders, namely trend follo...
متن کامل